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METHOD AND SYSTEM FOR DETERMINING DROPPED FRAME RATES OVER 

A PACKET SWITCHED TRANSPORT 

Background of the Invention 

5 1. Field of the Invention 

The present invention relates generally to testing telecommunications networks, and 
particularly to detecting dropped packets over a packet switched network. 

2. Technical Background 

10 New telecommunications technologies are emerging that employ packet switching 

instead of, or in addition to, the traditional circuit-switched technologies provided by the 
public switched telephone networks (PSTN). Providing full duplex voice over the Internet 
(VoIP) is of particular importance. VoIP services are attractive to commercial long-distance 
carriers because they enable the use of global Internet transport facilities to carry traffic that 

15 is presently being carried over dedicated circuit-switched facilities. The potential benefits are 
enormous, considering the possibilities for reduction in data exchange capacity required to 
support a telephone call, opportunities for developing new features and functions for voice 
services, and the economies of scale from the use of one kind of transport for all 
telecommunications services. However, a major impediment to the use of VoIP services is 

20 concern as to the likely user perception of the quality of full-duplex voice communications 
using VoIP. 

Telephone connections have always been subject to impairments in the form of noise, 
attenuation, distortion, cross-talk and echo. Such impairments are particularly common to 
analog portions of the network, such as subscriber loops and frequency domain multiplexing 

25 equipment. Digital transmission alleviates many of these problems but also introduces 
quantization noise and distortions due to bit errors in the digital signal. Even with perfect 
digital transmission applied to long haul transmissions, a typical telephone connection 
includes many analog components where impairments can occur. As a result, a poor 
connection or malfunctioning piece of equipment can produce unacceptably poor 

30 reproduction of voice, or conditions on a connection that customers will find objectionable or 
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intolerable. When there is a high incidence of poor connections, the customer may complain 
to the service provider or to a regulatory authority, or simply change long distance carriers. 
Thus, perceived quality of telephone connections is a major factor affecting the reputation 
and marketability of long distance telephone services. 
5 To guard against poor quality, service providers have developed methods to obtain 

objective quality measurements for a line, piece of equipment, or an end-to-end telephone 
connection. These measurements can help the service provider detect and gauge 
impairments, pinpoint weak elements, and correct deficiencies that degrade user perception of 

^ L quality. As a result, the average consumer has to come to expect a certain quality of service 

glO from the PSTN. 

CO With the proliferation of voice-over-packet technologies, maintaining quality of 

Q service comparable to the PSTN is a major concern of service providers, equipment vendors, 
rrj and ultimately the consumers of telecommunications services. Unlike circuit switched traffic, 
^ real time voice transmission using packet switched technologies is sensitive to the packet 

few? 

RJ 1 5 loss, packet delay, and jitter that are characteristic of packet switched networks. In 

Sj particular, packet loss and packet delay variations may result in transmissions missing some 

^ packets, thereby creating an audio signal that is distorted, garbled, or otherwise degraded. 

IntServ and Diffserv protocols have been proposed for improving the reliability and 
consistency of packet transport for packets carrying voice. RTCP (Real Time Transmission 
20 Control Protocol) is being deployed to enable real-time measurements of the receipt of packet 
data, and for reporting the measurements to a sender or to a network quality monitoring 
location. However, in a hybrid network that includes both a circuit switched network, such as 
the PSTN and a packet switched network, the detection of dropped packets is problematic, 
because none of the protocol data is relayed to the end station. The problem, then, is how to 
25 measure dropped frame rates codec-to-codec across a packet switched network when there is 
no access to packet transmission control data. This problem is exacerbated by the fact that 
dropped frame rates may be manifested in two distinct ways. First, the dropped packet may 
simply be skipped. If so, the result is a null (a segment of time with no signal energy at all) 
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in the received voice signal. Alternatively, when a packet has not been received in time to 
maintain a continuous flow of voice, the receiving codec may simply insert the previous 
packet or a segment of white noise to avoid a null. This packet loss concealment routine 
results in repetition of speech waveforms or other phenomena that distort speech signals. It 
5 also has the effect of disguising the fact that a dropped packet that would have otherwise been 
revealed by a null was lost. Thus, the presence of nulls will indicate dropped packets, when 
no packet concealment routine is applied, or the number of dropped packets exceeds the 
dynamic range of the operant packet loss concealment routine. However, the dropped 
packets whose occurrence is disguised by a packet loss concealment routine will be more 

p 10 difficult to detect mechanically. 

n 

S5 What is needed is a system and method for detecting dropped packets across a packet 

:f: switched network when there is no access to packet network transmission control data that 

H reliably detects dropped packets, absent any knowledge of whether, or what kind of, a packet 

hi 

a loss concealment technique is being used. 

m 15 

W Summary of the Invention 

O The present invention is directed to a system and method for detecting dropped 

fi l 

packets across a packet switched network when there is no access to packed switch 
transmission control data that reliably detects dropped packets. The present invention also 

20 provides a system and method for detecting dropped packets absent any knowledge of 
whether, or what kind of, a packet loss concealment technique is being used. 
One aspect of the present invention is a method for detecting dropped packets in a network that includes 
a packet switched network. The method includes establishing a telephonic connection 
between a first network location and a second network location. At least one set of N 

25 waveforms are transmitted from the first network location. Each transmitted waveform 

includes a waveform characteristic operative to assign a predetermined value relative to other 
waveforms in the at least one set, such that a predetermined sequence of values are assigned 
to packets carrying the N transmitted waveforms. At least one telephonic signal is received at 
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the second network location via the communications channel. The at least one telephonic 
signal is processed to obtain a received sequence of values. The received sequence of values 
is compared to the predetermined sequence of transmitted values to detect dropped packets 
without having access to packet switched network control data. 
5 In another aspect, the present invention includes a system for detecting dropped 

packets in a telecommunications network including a packet switched network. The system 
includes a transmission unit configured to send at least one set of N waveforms over the 
telecommunications network. Each transmitted waveform includes a waveform characteristic 
operative to assign a predetermined value relative to other waveforms in the at least one set, 
q 10 such that a predetermined sequence of values are assigned to packets carrying the N 
2 transmitted waveforms. A receiver unit is operative to receive a telephonic signal from the 

law 

4j telecommunications network. The receiver also is configured to derive a received sequence 
H= of values from the telephonic signal, and compare the received sequence of values to the 
5; predetermined sequence of values to detect dropped packets, without having access to packet 

Si 1 5 switched network transmission control data. 

In another aspect, the present invention includes a computer-readable medium having 

q computer-executable instructions for performing a method. The method includes 

n i 

transmitting at least one set of N waveforms from the first network location. Each transmitted 
waveform includes a waveform characteristic operative to assign a predetermined value 

20 relative to other waveforms in the at least one set, such that a predetermined sequence of 

values are assigned to packets carrying the N transmitted waveforms. At least one telephonic 
signal is received at the second network location via the communications channel. The at 
least one telephonic signal is processed to obtain a received sequence of values. The received 
sequence of values is compared to the predetermined sequence of transmitted values to detect 

25 dropped packets without having access to packet switched network control data. 

In another aspect, the present invention includes a computer-readable medium having 
computer-executable instructions for performing a method. The method includes establishing 
a telephonic connection between a first network location and a second network location. At 
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least one set of N waveforms is transmitted from the first network location. Each transmitted 
waveform includes a waveform characteristic operative to assign a predetermined value 
relative to other waveforms in the at least one set, such that a predetermined sequence of 
values are assigned to packets carrying the N transmitted waveforms. 
5 In another aspect, the present invention includes a computer-readable medium having 

computer-executable instructions for performing a method. The method includes receiving at 
least one telephonic signal from a telephonic connection. The at least one telephonic signal is 
processed to obtain a received sequence of values. The received sequence of values is 
compared to the predetermined sequence of transmitted values to detect dropped packets 

10 without having access to packet switched network control data. 

Additional features and advantages of the invention will be set forth in the detailed 
description which follows, and in part will be readily apparent to those skilled in the art from 
that description or recognized by practicing the invention as described herein, including the 
detailed description which follows, the claims, as well as the appended drawings. 

15 It is to be understood that both the foregoing general description and the following 

detailed description are merely exemplary of the invention, and are intended to provide an 
overview or framework for understanding the nature and character of the invention as it is 
claimed. The accompanying drawings are included to provide a further understanding of the 
invention, and are incorporated in and constitute a part of this specification. The drawings 

20 illustrate various embodiments of the invention, and together with the description serve to 
explain the principles and operation of the invention. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a hybrid telecommunications network in accordance 
25 with an embodiment of the present invention; 

Figure 2 is a detailed diagram of the test system for determining dropped packets 
depicted in Figure 1 ; and 

Figure 3 is a chart showing a method for determining dropped packets in accordance 
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with another embodiment of the present invention. 

Detailed Description 

Reference will now be made in detail to the present exemplary embodiments of the 
5 invention, examples of which are illustrated in the accompanying drawings. Wherever 
possible, the same reference numbers will be used throughout the drawings to refer to the 
same or like parts. An exemplary embodiment of the system of the present invention is 
shown in Figure 1 and 2, and is designated generally throughout by reference numeral 10. 
In accordance with the invention, the present invention is directed to a method for 
[3 10 detecting dropped packets in a network that includes a packet switched network. The method 
y includes establishing a telephonic connection between a first network location and a second 
*P network location. At least one set of N waveforms are transmitted from the first network 
M location. Each transmitted waveform includes a waveform characteristic operative to assign a 

predetermined value relative to other waveforms in the at least one set, such that a 
J:: : t 15 predetermined sequence of values are assigned to packets carrying the N transmitted 
111 waveforms. At least one telephonic signal is received at the second network location via the 
H communications channel. The at least one telephonic signal is processed to obtain a received 
sequence of values. The received sequence of values is compared to the predetermined 
sequence of transmitted values to detect dropped packets without having access to packet 
20 switched network control data. The system and method of the present invention detects 
dropped packets across a packet switched network when there is no access to packet switch 
transmission control data, and it is unknown whether packet loss concealment is in effect. 
Thus, both manifestations of a dropped packet are detected using one test signal. The test 
signal of at least one sequence of N waveforms is designed so that either nulls or lost packets 
25 that are concealed will produce values in the received sequence that differ from the 
predetermined sequence of transmitted values. 

As embodied herein, and depicted in Figure 1, a hybrid telecommunications network 
in accordance with the present invention is disclosed. Figure 1 shows one example of how 
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the present invention may be employed. Test system 10 of the present invention is coupled to 
public switched telephone network (PSTN) 12. PSTN 12 is coupled to packet switched 
network 16 by gateway 14. PSTN 12' is coupled to packet switched network 16 by way of 
gateway 18. Test system 10' is coupled to PSTN 12', In the example shown in Figure 1, 
5 system 10 initiates a call to system 10' by way of circuit switched PSTN 12. PSTN 12 routes 
the call to gateway 14. Gateway 14 converts time division multiplexed (TDM) signals into 
packets that are compatible with packet switched network 16. Gateway 14 has access to a 
directory of IP addresses of exit gateways. Gateway 14 uses the directory to select gateway 
1 8. Packet switched network 1 6 transports the packets to gateway 1 8. Gateway 1 8 converts 

5 10 the packets back into a TDM format compatible with PSTN 12'. PSTN 12' routes the TDM 

J;T signal to system 10'. Subsequently, test system 10 transmits a sequence of N test waveforms. 

HF System 10' receives the telephonic transmission via network 1, and determines if there are 
any dropped packets by processing the received waveforms to assign values associated with 

l" r each waveform, and comparing the assigned values to a predetermined sequence of values. 
1 5 This arrangement provides a method for detecting dropped packets across a packet switched 

II network without having access to packet transmission control data. 

si 

□ Packet switched network 16 is commonly referred to as a converged network. A 

converged network is adapted to carry various types of media, such as voice, data, and audio 
or video streams. Each of these media types are digitized and formatted into discrete packets 
20 of data. Packet switched network 16 may be of any suitable type, but there is shown by way 
of example an Internet Protocol (IP) network adapted to carry packet-switched voice, or 
Voice over the Internet (VoIP). In one embodiment, network 16 is the public Internet which 
comprises the worldwide collection of interconnected networks that are linked together by the 
use of the Internet Protocol (IP). This worldwide collection of networks includes a host of 
25 networks sponsored by academic, commercial, governmental, and military entities. In 

another embodiment, packet switched network 16 may include a packet switched network, or 
a collection of packet switched networks interconnected by a common protocol, not 
connected to the Internet. An example of such a network would be a privately owned 
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intranet, or enterprise network. In yet another embodiment, network 16 may include both 
enterprise networks, intranets, and the public Internet. 

As embodied herein and depicted in Figure 2, a detailed diagram of test system 10 is 
disclosed. System 10 is coupled to network 1 by way of telephone-line interface 42, 
5 Telephone-line interface 42 is bi-directionally coupled to codec 40. On the transmit side, a 
stored waveform is retrieved from memory (either RAM 102 or ROM 104) and provided to 
codec 40 via system bus 110. Codec 40 encodes the digitized sequence of N waveforms 
retrieved from memory into an analog signal suitable for insertion to the PSTN via a standard 
access loop. The encoded analog signal is provided to interface circuit 42 via the bi- 

10 directional connection, and transmitted over network 1. Each transmitted waveform is of a 
duration that matches the payload of a packet generated in a packet switched network 16 (See 
Figure 1). Thus, each transmitted waveform operates to assign a value to a packet carrying 
the transmitted waveform. Test system 10 also may function as a standard POTS telephone 
set. In this mode, A/D converter receives voice generated analog signals from telephone 

15 headset microphone circuit 34. 

Analog telephonic transmissions from network 1 are received from interface circuit 42 
and provided to codec 40, which creates PCM encoded digital images of the analog signal 
that is stored in a file in RAM 102. The file includes a digital representation of each of the 
received waveforms. Processor 100 is programmed to process the stored file to extract the 

20 appropriate waveform characteristic for each of the N transmitted waveforms that are 

received. In one embodiment, processor 100 is programmed to determine the average peak 
power of each received waveform. The average peak power is converted to a numerical value 
representing its rank among the average peak powers calculated for the N received 
waveforms, thereby creating a sequence of received values. The sequence of received values 

25 is compared to the sequence of values representing the analogous ranks of the average peak 
powers among the transmitted set of N waveforms. Since each transmitted waveform 
operates to assign a value to a packet carrying the transmitted waveform, the sequence of 
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received values indicates which packets successfully traversed the packet switched network 
16. 

The overall control of system 10 is provided by microprocessor 100. Microprocessor 
100 is coupled to RAM 102, ROM 104, secondary memory 106 and I/O circuit 108, by 
system bus 110. System bus 110 provides the necessary data, address, and control lines. 
Codec 40 is also coupled to microprocessor 100 by system bus 110. 

Telephone line interface 42 may be of any suitable type, but by way of example, 
interface 12 includes an integrated circuit, such as a Motorola MC3401OP, coupled to 
isolation transformers. The isolation transformers prevent grounding problems. One of 
ordinary skill in the art will recognize that the functional block depicted by interface 42 also 
includes DTMF capabilities. 

PCM codec transceiver 40 uses a standard digitization scheme to band limit voice 
frequencies to the 300 - 3300Hz frequency band. Codec 40 performs an A/D conversion of 
an analog signals using a PCM digitization scheme. In one embodiment for example, the 
PCM digitization results in a mu-law companded 64 kbps signal wherein larger amplitudes 
are compressed relative to the smaller amplitudes, providing an equivalent 12-bit accuracy 
within an 8-bit digital word carrying the values of amplitude sampled at the rate of 8000Hz. 
In one embodiment, codec 40 includes a semiconductor IC manufactured by SGS Thompson 
or by the National Semiconductor Company having the product number ETC5056, or 
equivalent. 

Read/write random access memory (RAM) 102 is used in data processing and data 
I/O. Read only memory (ROM) 104 is used to store the system 10 programming instructions 
used by processor 100. Those of ordinary skill in the art will recognize that ROM 104 can be 
implemented using DRAM, ROM, PROM, or EEPROM. The secondary memory 106 may 
be implemented using a hard drive, floppy diskettes, CD-ROM, or any other suitable 
computer readable medium. Programming instructions, waveform generation data, value 
sequences, and other data associated with the transmission and reception of the various sets of 
waveforms can be stored using ROM 104 or secondary memory 106. 
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In one embodiment, processor 100 is implemented using an off-the-shelf 
microprocessor such as a Pentium processor manufactured by Intel Those of ordinary skill 
in the art will also recognize that processor 100 can also be implemented using application 
specific integrated circuits (ASIC), or a combination of off-the-shelf processors and ASICs in 
the design. Signal processor 200 may be implemented using any suitable signal processing 
device such as a digital signal processor (DSP) manufactured by Motorola, or by some other 
manufacturer. 

In one embodiment, I/O circuit 108 supports a computer interface, a display such as a 
LCD device, and a user interface. The computer interface is adapted to communicate with an 
external computing device. For example, programming instructions or waveform set data 
stored in memory 104 can be completely replaced or partially replaced with new instructions 
down loaded from the external computing device. One of ordinary skill in the art will 
recognize that data flow is bi-directional. Processor 100 may transfer waveform data or 
telephonic transmission data to an external device for further processing and/or statistical 
analysis. The user interface may be of any suitable type, but there is included by way of 
example a telephone set twelve-key dialing device, a function key set, and a keyboard for 
data entry and programming functions. 

Figure 3 is a chart showing a method for determining dropped packets in accordance 
with another embodiment of the present invention. In step 400, a telephonic connection is 
established between test system 10 and test system 10'. After retrieving the set of N 
waveforms from memory, test system 10 is configured to transmit the set of N waveforms 
over the telecommunications network (N is an integer number). Each waveform possesses a 
different characteristic operant to distinguish it from the other waveforms in the set of N. The 
characteristic may be average signal power, peak power, frequency, a number of phase 
changes per waveform segment, a CELP waveform symbol, a bit-pattern reflected in a 
semantically encoded waveform, or any other suitable means of encoding a distinctive 
characteristic in a waveform. The set of N waveforms transmitted by system 10 thereby 
represents a predetermined sequence of values (1,... , N) that index the expected order of the 
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distinguishing characteristics of the N waveforms received and recorded by test system 10'. 
In one embodiment, each waveform in the set of N includes two waveform segments. The 
first segment is a sinusoidal wave transmitted at a minimum peak-power level close to a noise 
floor. The second segment is a sinusoidal wave transmitted at one of N equally spaced power 
5 levels between the minimum peak-power level and a maximum peak power level. Thus, the 
peak power of the second segment functions as the representative waveform characteristic of 
the transmitted waveform. In the case where N = 4, four two-portion waveforms are 
concatenated and transmitted by system 10 over the telephonic connection. Thus, the 
transmitted set of N waveforms represents a predetermined sequence of values (1, 2, 3, 4) 

10 corresponding to the relative magnitudes of peak power levels of the second segment of each 
waveform transmitted in sequence. Starting at step 406, the transmission received at test 
system 10' is processed to produce a corresponding received sequence of values that reveals 
the occurrence of dropped packets. Test system 10' receives the transmission from system 
10. The transmission is digitized and stored in memory. During post processing, the 

15 received transmission is divided into waveform sections having a duration substantially equal 
to each of the transmitted waveforms, i.e., the duration of a voice sample in a packet 
transmitted across packet switched network 16. A value is assigned to each waveform based 
on the relative magnitude of the maximum value of average peak power measured over small 
subdivisions of each waveform. This produces an integer sequence of values associated with 

20 the received set of N waveforms that are then compared to the predetermined sequence of 
values encoded by the transmitted set of N waveforms. Deviations from the predetermined 
sequence of values then reveal dropped packets. If a value in the sequence is zero, the 
receiver recognizes that the packet carrying the expected predetermined value was dropped 
without concealment. If the section sequence includes a repeated value, e.g., 1, 2, 2, 4, the 

25 receiver recognizes that the packet carrying value 3 was dropped and concealed. 

It will be apparent to those of ordinary skill in the pertinent art that modifications and 
variations can be made to the technique used to encode a predetermined value into a 
transmitted waveform, depending on the design of both the transmission test sub-system 30 
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and the receiver test sub-system 20. For example, a value may be encoded in the second 
segment of a waveform by the number of phase shifts in the second segment. In another 
embodiment, the value corresponds to the frequency of the transmitted sinusoid. 

In yet another embodiment, CELP (Code Excited Linear Prediction) coding is used to 
5 encode each predetermined value. CELP coding employs a library, or a table, of waveform 
symbols. Each waveform symbol has a numerical or alphabetical designation, e.g., symbol 1, 
symbol 2, symbol 3, and etcetera. On the receive side, processor 100 employs a look-up table 
to decipher each received CELP waveform. Thus, transmission of waveform symbol 1, 
waveform symbol 2, waveform symbol 3, and waveform symbol 4 correspond to the 
n 10 predetermined sequence 1,2, 3, and 4. If a waveform symbol is not present at its expected 
° location within the transmission, the packet carrying the missing symbol was dropped. 
Jp In yet another embodiment, semantically encoded waveforms are used to encode the 

U predetermined sequence of values. A waveform having semantic content is transmitted by 
}; y retrieving a predetermined bit pattern retrieved from memory (RAM 102 or ROM 104) and 

p 1 5 generating waveforms encoding that bit pattern in accordance with a predetermined data 

n..i 

fU modulation scheme that is fed into codec 40. On the receive side, codec 40 decompresses 

n and decodes the received signal to obtain a bit-pattern. The bit pattern is stored in a file and 

m read by microprocessor 100 during post processing. In this case, the predetermined sequence 

of values corresponds to a predetermined sequence of bit-patterns which are easily read by 
20 microprocessor 100. Reference is made to U.S. Patent No. 5,748,876, which is incorporated 
herein by reference as though folly set forth in its entirety, for a more detailed explanation of 
semantically encoded waveforms. 

In all of the above described embodiments, a received telephonic signal is compared 
to a predetermined sequence of values to detect dropped packets in a packet switched 
25 network, without having access to packet switched network transmission control data. 

It will be apparent to those skilled in the art that various modifications and variations 
can be made to the present invention without departing from the spirit and scope of the 
invention. Thus, it is intended that the present invention cover the modifications and 
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variations of this invention provided they come within the scope of the appended claims and 
their equivalents. 
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